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The present invention relates to an image signal 
processor, and, more particularly, to an image signal 
processor and a deficient pixel detection method which 
detect a deficiency contained in image signals and correct 
the deficiency- 
Solid state image pickup devices, such as CCD image 
sensors, may store a constant charge in a pixel regardless 
of the level of the received light. As a result, the pixel 
becomes a deficient pixel and outputs an image signal of a 
fixed level. 

To eliminate the influence of deficient pixels on an 
image reproduction screen, deficiency correction is 
performed on the image signals of deficient pixels acquired 
from the solid state image pickup device. 

Fig. 1 is a schematic block diagram of an image pickup 
device 100. The pickup device 100 has a CCD image sensor 1, 
a drive circuit 2, a timing control circuit 3, a signal 
processing circuit 4, a deficiency correction circuit 5 and 
a correction information memory 6. 

The CCD image sensor 1 has a matrix of light receiving 
pixels (not shown) which store charges according to the 
received image of a subject. The CCD image sensor 1 
transfers charges stored in the individual light receiving 
pixels line by line in accordance with a vertical drive 
signal OV and a horizontal drive signal OH, and produces an 
image signal YO according to a predetermined format. 

The drive circuit 2 produces the vertical drive signal 
OV and horizontal drive signal OH for driving the CCD image 
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sensor 1 in accordance with a vertical sync signal VD and a 
horizontal sync signal HD, and sends those drive signals to 
the CCD image sensor 1 . 

The timing control circuit 3 frequency-divides a 
5 reference clock having a given period to thereby produce the 
vertical sync signal VD that determines the vertical scan 
timing and the horizontal sync signal HD that determines the 
horizontal scan timing, and sends the sync signals VD and HD 
to the drive circuit 2. In the NTSC format, for example, 

10 the horizontal sync signal HD is produced by frequency- 
dividing a reference clock of 14.32 MHz by 910, and the 
vertical sync signal VD is produced by frequency-dividing 
the horizontal sync signal by 525/2. The timing control 
circuit 3 supplies the signal processing circuit 4 and the 

15 deficiency correction circuit 5 with a timing signal 

synchronous with the operational timing of the CCD image 
sensor 1. 

The signal processing circuit 4 performs a sample and 
hold process and level correction on the image signal YO 

20 supplied from the CCD image sensor 1, thereby generating an 
image signal Yl. The image signal YD repeats a signal level 
and reset level. In the sample and hold process, the signal 
processing circuit 4 produces the image signal Yl having the 
signal level from the image signal YO by clamping the reset 

25 level, for example. In the level correction, the signal 

processing circuit 4 performs gain feedback control on the 
image signal YO in such a manner that the average level of 
the image signal Yl lies in a target range. The signal 
processing circuit 4 samples and holds the image signal YO 

30 and performs A/D conversion on the resultant image signal YO, 
thus yielding a digital image signal Yl. 

The deficiency correction circuit 5 adjusts the image 
signal Yl using correction information stored in the 



correction information memory 6. For instance, information 
of a deficient pixel is replaced with the average value of 
information of pixels before and after the deficient pixel. 

The correction information memory 6 stores the 
positions of deficient pixels of the CCD image sensor 1. 
For example, the positions of deficient pixels are detected 
by monitoring the output of the CCD image sensor 1 
beforehand, and the detection result is stored as correction 
address information in the memory 6. 

Even when plural CCD image sensors 1 are constructed 
from semiconductor substrates that have been manufactured 
with the same process, the positions of deficient pixels 
differ from one sensor to another. It is therefore 
necessary to generate correction address information by 
detecting the positions of deficient pixels for each CCD 
image sensor 1. This increases the cost involved in the 
assembling process . 

The number of deficient pixels in the CCD image sensor 
1 may increase with time. When such time-dependent changes 
occur, the correction address information in the correction 
information memory 6 should be rewritten. However, ordinary 
users of image pickup devices do not have means for 
rewriting the contents of the correction information memory 
6. This makes it harder to rewrite the correction address 
information . 



SUMMARY OF THE INVENTION 

Accordingly, it is an objective of the present 
invention to provide a low-cost image signal processor 
capable of coping with deficient pixels in an image pickup 
device as time passes. 

To achieve this objective, according to a first aspect 




of this invention, there is provided an image signal 
processor for processing a plurality of image signals. The 
image signal processor comprises an image memory circuit for 
storing a signal corresponding to a target pixel and signals 
5 ' corresponding to a plurality of peripheral pixels adjacent 
to the target pixel. The image signal processor further 
comprises a deficiency candidate detection circuit, 
connected to the image memory circuit, for comparing the 
signal of the target pixel with a threshold value set in 

10 accordance with the signals of the plurality of peripheral 
pixels to thereby detect a deficient pixel candidate- Also 
provided is a deficiency determining circuit, connected to 
the deficiency candidate detection circuit, for determining 
a deficient pixel according to continuity of the deficient 

15 pixel candidate, detected by the deficiency candidate 

detection circuit, over a plurality of screens. A position 
memory circuit, connected to the deficiency determining 
circuit, stores deficiency information of a position of the 
deficient pixel determined by the deficiency determining 

20 circuit. Finally, a deficiency correction circuit, 

connected to the position memory circuit, corrects the 
signal of the target pixel which is deficient in accordance 
with the deficiency information. 

According to a second aspect of this invention, there 

25 is provided a method of detecting a deficient pixel in a 
plurality of pixels. The method comprises the steps of: 
detecting a deficient pixel candidate by comparing a signal 
of a target pixel with a threshold value set in accordance 
with signals of a plurality of peripheral pixels adjacent to 

30 the target pixel; storing a position of the detected 

deficient pixel candidate; recomparing a signal of that 
target pixel which corresponds to the position stored in the 
position storing step with the threshold value; storing a 




comparison result of the recomparing step; repeating the 
recomparing step and the comparison result storing step a 
predetermined number of times; and detecting a deficient 
pixel in accordance with a plurality of comparison results 
5 obtained from the repeating step. 

According to a third aspect of this invention, there is 
provided a method of detecting a deficient pixel in a 
plurality of pixels. The method comprises the steps of: 
detecting a first deficient pixel candidate by comparing a 

10 signal of a target pixel with a threshold value set in 

accordance with signals of a plurality of peripheral pixels 
adjacent to the target pixel; storing a position of the 
first deficient pixel candidate ; detecting a second 
deficient pixel candidate by comparing a signal of the 

15 target pixel with the threshold value; determining if a 

position of the first deficient pixel candidate coincides 
with a position of the second deficient pixel candidate; 
updating information of the stored position of the first 
deficient pixel candidate in such a way that only position 

20 information of that first deficient pixel candidate which 
has been determined to have a match in the coincidence 
determining step remains; repeating the second-deficient- 
pixel-candidate detecting step, the coincidence determining 
step and the updating step a predetermined number of times; 

25 and detecting a deficient pixel in accordance with position 
information of deficient pixel candidates acquired from the 
repeating step . 

Other aspects and advantages of the invention will 
become apparent from the following description, taken in 

30 conjunction with the accompanying drawings, illustrating by 
way of example the principles of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 



5 



The features of the present invention that are believed 
to be novel are distinctly set forth in the appended claims . 

The invention^ together with objects and advantages thereof, 
may best be understood by reference to the following 
description of the presently preferred embodiments together 
with the accompanying drawings in which: 

Fig. 1 is a schematic block diagram of a conventional 
solid state image pickup device; 

Fig. 2 is a schematic block diagram of an image signal 
processor according to a first embodiment of the invention; 

Fig. 3 is a schematic block diagram of an image memory 
circuit in the image signal processor in Fig. 2; 

Fig. 4 is a schematic plan view of pixels showing the 
positional relationship between a target pixel and 
peripheral pixels ; 

Fig. 5 is a schematic block diagram of a deficiency 
candidate detection circuit in the image signal processor in 
Fig. 2; 

Fig. 6 is a diagram showing the relationship between a 
threshold value and the levels of peripheral pixels; 

Fig. 7 is a flowchart for explaining the operation of a 
deficiency determining circuit; 

Fig. 8 is a schematic block diagram of an address 
generator in the image signal processor in Fig. 2; 

Fig. 9 is a schematic plan view of pixels for 
explaining the address of a deficient pixel on the screen; 

Fig. 10 is a schematic block diagram of a deficiency 
correction circuit in the image signal processor in Fig. 2; 

Fig. 11 is a schematic block diagram of an image signal 
processor according to a second embodiment of the invention; 

Fig. 12 is a schematic block diagram of an image signal 
processor according to a third embodiment of the invention; 

Fig. 13 is a schematic block diagram of an image signal 



processor according to a fourth embodiment of the inventions- 
Fig. 14 is a flowchart for explaining a first 
deficient-pixel detection method according to the invention; 
and 

Fig. 15 is a flowchart for explaining a second 
deficient-pixel detection method according to the invention. 



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
( First Embodiment ) 

Fig. 2 is a schematic block diagram of an image signal 
processor 10 according to the first embodiment of the 
invention. This image signal processor 10 is adapted for use 
in a solid state image pickup device. 

As shown in Fig. 2, the image signal processor 10 has 
an image memory circuit 11, a deficiency candidate detection 
circuit 12, a position memory circuit 13, a deficiency 
determining circuit 14, a deficiency registering circuit 15 
and a deficiency correction circuit 16. In an image pickup 
device, a digital image signal Y(n) is produced by 
performing a predetermined process on the output signal of 
the image pickup element and then performing A/D conversion 
on the processed signal. The image signal processor 10 
performs correction on the image signal Y(n) of a deficient 
pixel . 

The image memory circuit 11 has a plurality of line 
memories 21 and 22 and a plurality of latches 23 to 28 (see 
Fig. 3) . The image memory circuit 11 fetches image signals 
Y(n) line by line and simultaneously generates an image 
signal Y(P0) corresponding to a target pixel PO and image 
signals Y(P1) to Y(P8) corresponding to its peripheral 
pixels PI to P8 (see Fig. 4) . 

The deficiency candidate detection circuit 12 generates 
a first threshold value Lw for determining a white 




deficiency and a second threshold value Lb for determining a 
black deficiency from the image signals Y(P1) to Y(P8) of 
the peripheral pixels P1-P8 supplied from the image memory 
circuit 11. The deficiency candidate detection circuit 12 
5 compares the first and second threshold values Lw and Lb 
with the image signal Y(PO) to detect a pixel which is a 
possible deficient pixel (hereinafter referred to as 
"deficiency candidate") . 

The deficiency candidate detection circuit 12 detects a 

10 real deficient pixel, which is due to a physical deficiency 
of the solid state image pickup device, and an apparent 
deficient pixel, which is considered as an accidental 
deficient pixel due to some reasons related' to the subject 
itself, and being unidentifiable. The deficiency candidate 

15 detection circuit 12 outputs address information which 

indicates the position of a deficient pixel. For example, 
the number of pixels is counted in synchronism with the 
image signals Y(n) and the count value when a deficient 
pixel is detected is output as address information. 

20 The position memory circuit 13 includes a volatile 

first memory 13a, such as a static memory (SRAM) , capable of 
operating fast and a non-volatile second memory 13b, such as 
a programmable memory (EEPROM) . The position memory circuit 
13 stores pixel position information indicating address 

25 information supplied from the deficiency candidate detection 
circuit 12 and deficiency determining circuit 14. 

The first memory 13a stores address information which 
is temporarily generated in the process of determining a 
deficient pixel. The second memory 13b stores address 

30 information of a pixel which is finally confirmed to be a 
deficient pixel through the deficient-pixel determining 
process . 

The deficiency determining circuit 14 determines 
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whether a pixel corresponding to the address stored in the 
position memory circuit 13 is a real deficient pixel or not, 
based on the continuity of a deficiency candidate over a 
plurality of screens. Specifically, when a deficient pixel 
is accidentally detected because of some reasons on the 
subject side, i.e., related to the subject, the deficient 
pixel will not be detected after a certain time passes. 
When a deficient pixel is detected continuously over a 
predetermined time period, therefore, the deficiency 
determining circuit 14 determines a real deficient pixel. 

As the pixel at the address stored in the position 
memory circuit 13 is continuously determined to be a 
deficiency candidate over a plurality of screens by the 
deficiency candidate detection circuit 12, the continuity of 
the deficient pixel is judged. Alternatively, the 
continuity of a deficient pixel is judged by comparing 
address information indicating deficiency candidates 
obtained for the individual screens with one another while 
continuously operating the deficiency candidate detection 
circuit 12 over a plurality of screens. When the detection 
operation of the deficiency determining circuit 14 is the 
same as the detection operation of the deficiency candidate 
detection circuit 12, part of the deficiency candidate 
detection circuit 12 may be shared. 

The deficiency registering circuit 15 supplies the 
position memory circuit 13 with address information of the 
pixel that has been determined as a real deficient pixel by 
the deficiency determining circuit 14. 

The deficiency correction circuit 16 replaces the image 
signal Y(PO) of the deficient pixel with a correction signal 
Y(c) in accordance with the address information which is 
stored in the position memory circuit 13 by the deficiency 
registering circuit 15. The correction signal Y(c) is 




produced by, for example, averaging the image signals of a 
plurality of peripheral pixels located around the target 
pixel. As a result, the deficiency correction circuit 16 
outputs an image signal Y' (n) with corrected white and 
5 black deficiencies. 

In the detection of a deficient pixel, each of the 
first and second threshold values Lw and Lb may be separated 
into a plurality of sub-threshold values so that a deficient 
pixel candidate is weighted using the sub-threshold values. 

10 The noticeability of a deficient pixel which deviates 
significantly from the predetermined first and second 
threshold values Lw and Lb differs from the noticeability of 
a deficient pixel which deviates slightly from the threshold 
values. The deficiency candidate detection circuit 12 

15 determines the level of a deficient pixel (signal) using the 
sub-threshold values and stores the level of the deficient 
pixel in the position memory circuit 13. If the number of 
deficient pixels which can be registered in the position 
memory circuit 13 is limited, the deficiency registering 

20 circuit 15 can register the levels of those pixels which 
have highly deficient pixel levels by priority. If the 
position memory circuit 13 has no more space for registering 
the level of a new deficient pixel, the deficiency 
registering circuit 15 compares the deficient level of a 

25 pixel to be newly registered with that of a pixel already 

registered and rewrites information of a deficient pixel in 
accordance with the comparison result- This allows a 
deficient pixel which is more noticeable on the screen to be 
corrected with priority. 

30 The individual circuits of the image signal processor 

10 will be discussed in detail below. 

Fig. 3 is a schematic block diagram of the image memory 
circuit 11. As mentioned earlier, the image memory circuit 
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11 includes the first and second line memories 21 and 22 and 
the first to sixth latches 23 to 28. 

The line memories 21 and 22 are connected in series. 
The image signals Y(n) are written in the first line memory 
21 and the image signals Y(n) that are sequentially read 
from the first line memory 21 are written in the second line 
memory 22. With respect to sequentially supplied image 
signals Y(n), the image signals Y(n) of the preceding line 
are read from the first line memory 21 and the image signals 
Y(n) of the line before the preceding one are read from the 
second line memory 22. 

The first and second latches 23 and 24 are connected in 
series- The image signal Y(n) of the pixel preceding the 
present one is latched in the first latch 23, and the image 
signal Y(n) of the pixel just before the preceding one is 
latched in the second latch 24. As shown in Fig. 3, the 
image memory circuit 11 outputs the image signal Y(n) as the 
image signal Y(P8) corresponding to the peripheral pixel PB, 
and the first and second latches 23 and 24 respectively 
output the image signals Y(P7) -^and Y(P6) corresponding to 
the peripheral pixels P7 and P6. 

The third and fourth latches 25 and 26 are connected in 
series to the first line memory 21. The image signal Y(n) 
of the pixel that is located one line and one pixel before 
the present one is latched in the third latch 25, and the 
image signal Y(n) of the pixel that is located one line and 
two pixels before the present one is latched in the fourth 
latch 26. Therefore, the first line memory 21 outputs the 
image signal Y{P5) corresponding to the peripheral pixel P5, 
and the third and fourth latches 25 and 26 respectively 
output the image signal Y(PO) corresponding to the target 
pixel PO and the image signal Y(P4) corresponding to the 
peripheral pixel P4 . 



Likewise, fifth and sixth latches 27 and 28 are 
connected in series to the second line memory 22. The image 
signal Y(n) of the pixel that is located two lines and one 
pixel before the present one is latched in the fifth latch 
5 21, and the image signal Y(n) of the pixel that is located 
two lines and two pixels before the present one is latched 
in the sixth latch 28. Therefore, the second line memory 22 
outputs the image signal Y(P3) corresponding to the 
peripheral pixel P3, and the fifth and sixth latches 27 and 

10 28 respectively output the image signals Y(P2) and Y(P1) 
corresponding to the peripheral pixels P2 and Pi. 

The image memory circuit 11 generates the image signal 
Y(PO) of the target pixel PO and the image signals Y(P1)- 
Y(P8) of the peripheral pixels P1-P8, located around the 

15 target pixel PO, in parallel from the image signal Y(n). 

Fig. 5 is a schematic block diagram of the deficiency 
candidate detection circuit 12. The deficiency candidate 
detection circuit 12 has an average level computation 
section 31, a maximum level detection section 32, a minimum 

20 level detection section 33, first and second subtracters 34 
and 35, an adder 36, and first and second comparators 37 and 
38. 

The average level computation section 31 fetches the 
image signals Y(P1)-Y(P8) of the peripheral pixels P1-P8 and 

25 calculates an average level Lav. 

The maximum level detection section 32 detects a 
maximum level Lmax in the levels of the image signals Y{P1)- 
Y(P8), and the minimum level detection section 33 detects a 
minimum level Lmin. 

30 The first subtracter 34 subtracts the minimum level 

Lmin, supplied from the minimum level detection section 33, 
from the maximum level Lmax supplied from the maximum level 
detection section 32 to thereby compute a level difference 

12 




AL. 

The adder 36 adds the level difference AL to the 
average level Lav supplied from the average level 
computation section 31 to thereby generate a first threshold 
5 value Lw for determining a white deficiency. 

The second subtracter 35 subtracts the level difference 
AL from the average level Lav supplied from the average 
level computation section 31 to thereby generate a second 
threshold value Lb for determining a black deficiency. 

10 The first comparator 37 compares the second threshold 

value Lb from the second subtracter 35 with the image signal 
Y(PO) of the target pixel PO, and generates an H-level 
detection signal Db when the level of the image signal Y(PO) 
has not reached the threshold value Lb. That is, the first 

15 comparator 37 generates the H-level detection signal Db when 
the target pixel PO is determined to have a black deficiency. 

The second comparator 38 compares the first threshold 
value Lw from the adder 36 with the image signal Y(PO) of 
the target pixel PO, and generates an H-level detection 

20 signal Dw when the level of the image signal Y(PO) exceeds 
the threshold value Lw. That is, the second comparator 38 
generates the H-level detection signal Dw when the target 
pixel PO is determined to have a white deficiency. 

Fig. 6 shows the relationship between the levels of 

25 image signals representing the peripheral pixels located 
around a target pixel and the threshold value that is 
computed by using those image signals. Fig. 7 is a 
flowchart illustrating procedures of a deficiency candidate 
determining routine which is performed by the deficiency 

30 candidate detection circuit 12. 

The deficiency candidate determining routine according 
to the first embodiment determines whether the target pixel 
PO has a deficiency or not by referring to the eight 
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peripheral pixels P1-P8 adjacent to the target pixel PO, as 
shown in Fig. 4. 

In step SI in Fig. 7, the average level computation 
section 31 calculates the average level Lav of the image 
5 signals Y(P1)-Y(P8) for eight peripheral pixels P1-P8. 

In step S2, the maximum level detection section 32 and 
minimum level detection section 33 detect the maximum level 
Lmax and minimum level Lmin of the image signals Y(P1)-Y(P8)- 
The first step SI and second step S2 may be carried out in 
10 any order. 

In step S3, the first subtracter 34 subtracts the 
minimum level Lmin from the maximum level Lmax to thereby 
compute the level difference AL. 

In step 84, the second subtracter 35 subtracts the 
15 level difference AL from the average level Lav, thereby 

generating the second threshold value Lb for determining a 
black deficiency. The adder 36 adds the level difference AL 
to the average level Lav, thereby generating the first 
threshold value Lw for determining a white deficiency. 
20 In step S5, the first and second comparators 37 and 38 

compare the second and first threshold values Lb and Lw with 
the image signal Y{PO) to determine a candidate for a 
deficient pixel, and respectively generate the detection 
signals Db and Dw. 
25 The first threshold value Lw and second threshold value 

Lb that have been generated through the first to fifth steps 
S1-S5 are held fixed according to the conditions of the 
peripheral pixels. 

The first and second threshold values Lw and Lb 
30 approach the average level Lav when the level difference AL 
of the peripheral pixels is small and deviate from the 
average level Lav when the level difference AL is large. 
Therefore, the range of the first and second threshold 
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values Lw and Lb becomes narrower in a pixel area whose 
contrast difference on the screen is small whereas the range 
of the threshold values Lw and Lb becomes wider in a pixel 
area whose contrast difference on the screen is large. 
Therefore, a visually noticeable deficient pixel (deficiency 
candidate) in each pixel area is detected efficiently. 

Fig,. 8 is a schematic block diagram of an address 
generator 12a in the deficiency candidate detection circuit 
12, which generates the pixel address information of a 
deficiency candidate . 

The address generator 12a has a horizontal counter 51, 
a vertical counter 52, a horizontal data latch 53 and a 
vertical data latch 54. 

The horizontal counter 51 is reset in accordance with a 
horizontal sync signal HDl and performs a count-up operation 
according to a clock CKl which is synchronous with the 
detection operation of the deficiency candidate detection 
circuit 12. The horizontal counter 51 counts horizontal 
pixel numbers by repeatedly counting one line of pixels in 
each horizontal scan period. 

The vertical counter 52 is reset in accordance with a 
vertical sync signal VDl and performs a count-up operation 
according to the horizontal sync signal HDl. The vertical 
counter 51 counts vertical pixel numbers by repeatedly 
counting one screen of horizontal scan lines in each 
vertical scan period. 

The horizontal data latch 53, connected to the 
horizontal counter 51, fetches the count value of the 
horizontal counter 51 in response to one of the detection 
signals Db and Dw . When one of the detection signals Db and 
Dw rises, for example, the horizontal data latch 53 outputs 
a horizontal address signal Fh . The horizontal address 
signal Fh indicates the horizontal position of the pixel 




that has been detected by the deficiency candidate detection 
circuit 12. 

The vertical data latch 54, connected to the vertical 
counter 52, fetches the count value of the vertical counter 
5 52 in response to one of the detection signals Db and Dw. 
When one of the detection signals Db and Dw rises, for 
example, the vertical data latch 54 outputs a vertical 
address signal Fv . The vertical address signal Fv indicates 
the vertical position of the pixel that has been detected by 

10 the deficiency candidate detection circuit 12. 

When the screen has pixels of 6 rows by 8 columns as 
shown in Fig. 9, for example, the horizontal counter 51 
repeats counting in the range of "1" to "8" and the vertical 
counter 52 repeats counting in the range of "1" to "6". If 

15 there is a possible deficient pixel at the third row and the 
third column, the horizontal data latch 53 outputs the 
horizontal address signal Fh of "3" in response to the . 
rising of the detection signal Db or Dw. In response to the 
rising of the detection signal Db or Dw, the vertical data 

20 latch 54 outputs the vertical address signal Fv of "3". The 
address signals Fh and Fv indicate the address of the 
possible deficient pixel and are supplied to the deficiency 
determining circuit 14. 

Fig. 10 is a schematic block diagram of the deficiency 

25 correction circuit 16. 

The deficiency correction circuit 16 has first to 
fourth subtracters 61 to 64, first to third adders 65 to 67, 
a selector 68 and a comparator 69. 

The deficiency correction circuit 16 generates the 

30 correction signal Y(c) using the image signals Y(P2) and 

Y(P7) of the peripheral pixels P2 and P7 located above and 
below the target pixel PO and the image signals Y(P4) and 
Y(P5) of the peripheral pixels P4 and P5 located left and 



right to the target pixel PO. 

The first to fourth subtracters 61-64 respectively 
divide the image signals Y(P2), Y(P7), Y(P4) and Y(P5) 
supplied from the image memory circuit 11 by "4". 

The first adder 65 adds the subtractions results from 
the first and second subtracters 61 and 62 and the second 
adder 66 adds the subtractions results from the third and 
fourth subtracters 63 and 64 . 

The third adder 67 adds the addition result from the 
first adder 65 to the addition result from the second adder 
66, thereby generating the correction signal Y(c). 

The selector 68 selects either the image signal Y(PO) 
or the correction signal Y(c) in response to a select 
control signal S supplied from the comparator 69. When the 
correction signal Y(c) is selected, the selector 68 outputs 
an image signal Y' (PO) obtained by correcting the image 
signal of the deficient pixel. 

The comparator 69 compares the horizontal address 
signal Fh and vertical address signal Fv stored in the 
position memory circuit 13 with horizontal reference 
information Rh and vertical reference information Rv, which 
change in synchronicity with the horizontal scan. The 
comparator 69 generates the select control signal S when the 
horizontal address signal Fh matches with horizontal 
reference information Rh and the vertical address signal Fv 
matches with the vertical reference information Rv. The 
horizontal reference information Rh and vertical reference 
information Rv can be generated by using the horizontal 
counter 51 and vertical counter 52 of the address generator 
12a shown in Fig. 8. 

When the horizontal address signal Fh and vertical 
address signal Fv respectively coincide with the horizontal 
reference information Rh and vertical reference information 
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Rv, therefore, the selector 68 replaces the image signal 
Y(PO) of the target pixel PO with the correction signal Y(c). 
As a result, the image signal of the deficient pixel is 
corrected by the information from its peripheral pixels . 

( Second Embodiment ) 

Fig. 11 is a schematic block diagram of an image signal 
processor lOA according to the second embodiment of the 
invention . 

The image signal processor lOA of the second embodiment 
determines a deficiency of a target pixel using the image 
pickup conditions of the image pickup device that generates 
image signals Y(n) in addition to the continuity of a 
deficient pixel. 

A deficiency determining circuit 14A repeats 
determination on deficient pixels in accordance with the 
address information of deficiency candidates stored in the 
position memory circuit 13, thereby updating the address 
information . In the determination of a deficiency candidate , 
for instance with the deficiency candidate detection circuit 
12, the deficiency determining circuit 14A determines a 
deficient pixel, receives information indicating the 
operational state of the image pickup device and changes the 
threshold level for determination according to the 
information . 

When the luminance of the image of the subject is 
relatively high, a white deficiency is not noticeable. When 
the luminance of the image of the subject is relatively low, 
on the other hand, a black deficiency is not noticeable. If 
determination of a deficient pixel is executed based merely 
on the level of the image signal Y(n), therefore, a real 
deficient pixel may not be determined properly. To avoid 
such an inconvenience, in accordance with the image pickup 
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conditions, such as exposure control i 
indicating the operational state of th 
and gain control information G (m) , the 
determining circuit 14A changes the th 
5 deficient pixel, or temporarily stops 
deficient pixel depending on the condi 
For instance, the deficiency determini 
estimates the luminance of the subject 
control information E (m) and gain cont 
10 stops determination of a white deficie 
subject's luminance exceeds a certain 
stops determination of a black deficie 
subject's luminance has not reached a 
level. 

15 In addition to the exposure control information E (mj 

and gain control information G (m) , information that is used 
in image pickup control in the image pickup device may be 
used in the determining operation. For instance, focus 
control information for controlling the focus of the optical 

20 system of the image pickup device may be used to initially 
determine a deficiency before the focus is set. There is a 
clear difference between a real deficient pixel and 
peripheral pixels even when the focus of the optical system 
of the image pickup device is not fixed. Therefore, making 

25 a deficiency determination before the focus is set can 
ensure a more accurate determination. 

The deficiency determining circuit 14A may determine a 
deficient pixel using only the image signals Y(n) and may 
add control information, such as the exposure control 

30 information E (m) and gain control information G (m) , to the 
address information that is acquired from the determination 
result. That is, it is possible to choose whether or not to 
execute correction at the time of correcting a deficient 
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pixel, in accordance with the image pickup control 
information added to the address information. 
(Third Embodiment ) 

Fig. 12 is a schematic block diagram of an image signal 
processor lOB according to the third embodiment of the 
invention. The image signal processor lOB of the third 
embodiment has an area designating circuit 17 in addition to 
the components of the image signal processor 10 of the first 
embodiment . 

The image signal processor lOB limits the area of an 
image where the detection by the deficiency candidate 
detection circuit 12 is to be carried out. A deficiency 
determining circuit 14A, like that of the image signal 
processor lOA of the second embodiment, may determine a 
deficient pixel by using the image signals Y(n) and image 
pickup information of the image pickup device. 

The area designating circuit 17 divides one screen into 
a plurality of sub-areas in synchronism with the horizontal 
scan timing and vertical scan timing of the image signals 
Y(n). The area designating circuit 17 controls the 
deficiency candidate detection circuit 12 in such a way that 
a deficiency candidate is detected for each sub-area. For 
example, the area designating circuit 17 divides the 
horizontal scan period by four and divides the vertical scan 
period by three, thereby separating one screen into 12 areas 
of 3 rows by 4 columns. The deficiency candidate detection 
circuit 12 performs deficiency detection for each sub-area. 

The area designating circuit 17 changes a sub-area 
where detection of a deficient pixel is performed, in 
accordance with an instruction from the deficiency 
registering circuit 15. That is, when the address of a 
deficient pixel in one sub-area is fixed and the deficiency 
registering circuit 15 completes registration of the address 



information of the deficient pixel, the area designating 
circuit 17 changes the sub-area. Even when a deficient 
pixel is not detected in a sub-area and when the deficiency 
registering circuit 15 has not performed registration of a 
5 deficient pixel, a sub-area is changed when a predetermined 
deficiency detection process is completed. Accordingly, the 
deficiency candidate detection circuit 12 detects a 
deficient pixel for each sub-area on the screen. 

The deficiency candidate detection circuit 12 detects 

10 more pixels than will finally be registered as deficient 
pixels. For temporary storage of the address of each 
detected pixel, therefore, the position memory circuit 13, 
particularly, the first memory 13a, needs a large capacity. 
As the deficiency candidate detection circuit 12 operates in 

15 a time-division multiplexed manner in the third embodiment, 
the capacity of the position memory circuit 13 is reduced. 
( Fourth Embodiment ) 

Fig. 13 is a schematic block diagram of an image signal 
processor IOC according to the fourth embodiment of the 

20 invention. The image signal processor IOC of the fourth 
embodiment has an interface circuit 18 in addition to the 
components of the image signal processor 10 of the first 
embodiment . 

The deficiency determining circuit 14A of the image 
25 signal processor IOC, like that of the image signal 

processor lOA in Fig. 11, may determine a deficient pixel by 
using the image signals Y(n) and image pickup information of 
the image pickup device. In addition, the area designating 
circuit 17 may also be provided. 
30 The interface circuit 18 is connected to a serial bus 

19 via which the image signal processor IOC is connected to 
an external computer (not shown) . The computer changes 
address information stored in the position memory circuit 13 
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and the threshold level for determination by the deficiency 
determining circuit 14A through the interface circuit 18. 
For example, the computer chooses whether or not to use the 
exposure control information E (m) and gain control 
5 information G (m) . If this information is to be used, it is 
supplied to the deficiency- determining circuit 14A. When 
information E (m) and G (m) is used, the computer sets which 
information has a high priority, through the serial bus 19 
and the interface circuit 18. The divisional method of the 

10 area designating circuit 17 is changed by the computer. 

The interface circuit 18 may be connected directly to 
the deficiency determining circuit 14A and deficiency 
registering circuit 15. 

A method of detecting a deficient pixel according to 

15 the invention will now be described. 

Fig. 14 is a flowchart for explaining a first 
deficient-pixel detection method according to the invention. 

The first deficient-pixel detection method is executed 
by the deficiency candidate detection circuit 12, the 

20 position memory circuit 13, the deficiency determining 

circuit 14, the deficiency registering circuit 15 and the 
deficiency correction circuit 16 in the image signal 
processor 10 (lOA, lOB or IOC) . 

In step SIO in Fig. 14, the deficiency candidate 

25 detection circuit 12 detects a candidate for a deficient 
pixel (see Fig. 7) with, for example, one screen of image 
signals taken as a unit. The address information that 
indicates the position of the deficiency candidate is stored 
in the position memory circuit 13. 

30 In step S20, the deficiency determining circuit 14 

performs a detecting operation (see Fig. 7) on the image 
signal Y(n) of the pixel that is designated by the address 
information stored in the position memory circuit 13 with, 
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for example, the next screen of image signals taken as a 
unit . 

In step S30, with regard to the pixel that has been 
determined as a deficiency candidate, the determination 
5 result is stored. For example, the number of times the 
target pixel is determined as a deficiency candidate is 
accumulated and recorded. 

In step S40, it is determined whether the number of 
determination processes on a deficient pixel performed by 
10 the deficiency determining circuit 14 lies within a 

predetermined specified number or not. When the number of 
determination processes lies below the specified number, the 
processes of steps S20 and S30 are repeated until the former 
number reaches the specified number. Therefore, the 
15 deficiency determining circuit 14 performs determination on 
a deficiency candidate over a plurality of screens. 

When the number of determination processes reaches 
within the specified number, on the other hand, the flow 
proceeds to step S50. 
20 In step S50, the deficiency determining circuit 14 

determines, as a real deficient pixel, the pixel which has 
been determined as a deficiency candidate some number of 
times greater than the threshold value. 

The deficiency registering circuit 15 registers the 
25 address of the pixel that has been determined as a real 
deficiency candidate in the second memory 13b of the 
position memory circuit 13. 

In step S60, the deficiency correction circuit 16 
performs correction on the image signal of the pixel whose 
30 address has been registered in the position memory circuit 
13, thereby generating the image signal Y'(n) with the 
deficiency corrected . 

The processes of steps SIO to S60 determine a deficient 
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pixel from the conditions of pixels over a plurality of 
screens as well as from the conditions of one screen of 
pixels. This makes it possible to distinguish a real 
deficient pixel from an accidental deficient pixel which is 
due to the state of the subject. 

The greater the number of times determination of a 
deficient pixel is performed, the longer the time needed for 
the determination but the more accurate the determination 
result would be. When the determination of a real deficient 
pixel in step S50 is executed by using various kinds of 
control information, such as the exposure control 
information E (m) , gain control information G (m) and focus 
control information, the determination precision is further 
improved. 

Fig. 15 is a flowchart for explaining a second 
deficient-pixel detection method according to the invention. 

The second deficient-pixel detection method is executed by 
the deficiency candidate detection circuit 12, the position 
memory circuit 13, the deficiency determining circuit 14, 
the deficiency registering circuit 15 and the deficiency 
correction circuit 16 in the image signal processor 10 (lOA, 
lOB or IOC) . 

In step SlOO in Fig. 15, the deficiency candidate 
detection circuit 12 detects a deficient pixel candidate on 
the initial screen (see Fig. 7), and stores pixel address 
information of all deficiency candidates on one screen (or a 
sub-area) in the position memory circuit 13.' 

In step S200, the deficiency determining circuit 14 
detects a deficiency candidate on the next screen . 

In subsequent step S300, the deficiency determining 
circuit 14 determines whether the pixel address of the 
deficiency candidate that has been detected in step S200 
matches with the pixel address that is stored in the 



position memory circuit 13 in step SIOO. 

In step S400, the deficiency determining circuit 14 
updates the pixel address information of the deficiency 
candidate which is stored in the position memory circuit 13. 
This update causes only the address information which has 
been confirmed to have a match in step S300 to remain and 
delete the other address information which has not been 
confirmed to have a match. 

Alternatively, in step S300, the deficiency determining 
circuit 14 may leave only the address information which has 
been confirmed to have a match consecutively for a 
predetermined number of times (the number of screens) or 
delete the other address information which has not been 
confirmed to have a match consecutively for a predetermined 
number of times (the number of screens) . Whether to leave 
or delete the address information depends on whether or not 
to rewrite the information in the position memory circuit 13. 

In step S500, when the number of updates of the 
deficiency information lies within a predetermined specified 
number, the flow returns to step S200 and detection of a 
deficiency candidate is repeated. When the number of 
updates of the deficiency information reaches the 
predetermined specified number, the flow returns to step 
S600, Apparently, the deficiency determining circuit 14 
determines a deficient pixel over plural screens . 

In step S600, the address information stored in the 
position memory circuit 13 is fetched into the deficiency 
registering circuit 15, which in turn registers the address 
information of a real deficient pixel into the second memory 
13b of the position memory circuit 13. 

In step S700, the deficiency correction circuit 16 
performs correction of the image signal of the pixel whose 
address is registered in the second memory 13b and generates 




the image signal Y'(n) with a deficiency correction. 

The processes of steps SlOO to S700 determine a 
deficient pixel from the conditions of pixels over a 
plurality of screens as well as from the conditions of one 
5 screen of pixels. This makes it possible to distinguish a 
real deficient pixel from an accidental deficient pixel 
which is due to the state of the subject. 

The above-described embodiments may be modified in the 
following manner. 
10 (1) The first and' second threshold values Lw and Lb 

may be set in accordance with 14 peripheral pixels arranged 
in a matrix of 3 rows by 5 columns or 24 peripheral pixels 
arranged in a matrix of 5 rows by 5 columns . 

(2) The deficiency determining circuit 14 may continue 
15 the deficiency determining operation over a plurality of 

fields and may stop operating together with the deficiency 
candidate detection circuit 12 after the position of a 
deficient pixel is determined. 

(3) The deficiency determining circuit 14 may repeat 
20 the deficiency determining operation in a predetermined 

cycle . 

Although the embodiments of the present invention have 
been described herein in conjunction with the accompanying 
drawings;- the invention is not to be limited to the details 
25 given herein, but may be modified within the scope and 
equivalence of the appended claims. 
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